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MULTIMEDIA DATA TRANSMISSION SYSTEM 



DESCRIPTION 



Technical field 

This invention relates to a multimedia data 
transmission system. 

St:at;e of prior art 

5 Conventional multimedia servers are designed to be 

accommodated on a single platform. Usually, they 
consist simply of an application that runs on a 
computer equipped with interface cards to the telephone 
network . 

10 In its most widely distributed form, a host server 

is capable of finding data on external data servers 
accessible through the same LAN, using RPC (Remote 
Procedure Call) or ODBC (Open DataBase Connectivity) 
type protocols . 

15 This type of structure is suitable for the 

accommodation of simple multimedia servers in which 
there is no dynamic information. A company that would 
like to have a seirver accommodated describes the 
required service logic (if the user types #1, "you 

2 0 typed 1".... should be displayed) statically, and this 

logic runs on the service supplier accommodation 
platform independently. 

On the other hand, it becomes impossible to 
accommodate an application that requests information 
25 that necessitates close integration with one of the 
company's vital databases (booking statements, etc.), 
and the company must equip itself with its own 
infrastructure . 

More and more companies would like to integrate 

3 0 this type of multimedia service more closely with 
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internal data in their industrial process. The 
objective is to inform the customer in real time if the 
ticket that he has just purchased is available, the 
value of his share portfolio, etc. These are dynamic 
5 data that are only available within the company. 

Conventional multimedia accommodation services are 
not capable of satisfying these requirements, such that 
requesting companies are obliged to install their own 
server with the associated investments (private 

10 telephone exchange, telephone lines, etc.). 

In order to overcome the disadvantages of this type 
of server, the invention proposes a multimedia data 
transmission system, the purpose of which is to provide 
a dynamic multimedia service for companies who would 

15 like it, without obliging the company to purchase any 
hardware and while making a server accessible to the 
company using several technologies (particularly from 
the telephone network and from the Internet network) , 
with fully transparent service logic. 

20 

Description of the invention 

The system according to the invention relates to a 
multimedia data transmission system characterized in 
that it comprises a WAN, in which the confidentiality 

25 and security are not controlled from end to end, onto 
which a shared voice and/or video resources host server 
designed to provide a dynamic service to at least one 
user, and at least one call control server located at 
each service supplier are connected. 

3 0 Advantageously, the host -server connected to the 

network through an interface is composed of five 
subsystems : 

• A protocol stack subsystem with an interface that: 
- receives calls from the data network at the 
3 5 exchange ; 

SP 15889 C/DB 
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- detects incoming calls and captures caller and 
called party nioitibers; 

- detects dial tones; 

- generates arbitrary coding-decoding media data 
5 streams; 

- receives arbitrary media coding-decoding data 
streams . 

• A command interpreter subsystem capable of: 

- generating messages on detection of new calls to a 
10 call control server placed at a customer; 

- generating event messages; 

- making use of commands originating from call 
control servers placed at customers, such as: 

* order to play a pre-recorded audio or video file, 
15 * order to synthesize a voice message starting from 

a text , 

* order to start waiting for a dial tone, 

* order to disconnect the call, 

* order for voice recognition or other application. 
20 • A high performance transcoding resource subsystem. 

• A voice synthesis and/or video resource subsystem. 

• An audio or video sequences recording/reproduction 
module subsystem. 

Advantageously, each call control server located at 
25 a customer is software that receives events signaled by 
the host server and sends commands in reaction to these 
events . This software can run on a computer equipped 
with two network interfaces, one connected to the WAN 
to communicate with the host server, and the other 
3 0 connected to a company private network in order to 
dialog with databases and other industrial processes 
belonging to the customer. 

Thus, a new generation "accommodation" service can 
be provided in which all expensive resources (voice 
35 synthesis cards, etc.) are shared, while the customer 
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maintains control over the application and can 
interface it with whatever resources he wishes . 

Brief description of the drawings 

5 - Figure 1 illustrates a first embodiment of the 

invention; 

- Figure 2 illustrates the dialog between an 
operator server with voice recognition and the 
server belonging to a company A; 

10 - Figure 3 illustrates an example of a voice 

recognition procedure; 

- Figure 4 illustrates an embodiment of a 
specialized page that reacts to voice. 

15 Detailed presentation of an embodiment 

The invention relates to a multimedia data 
transmission system that comprises a WAN, which may or 
may not be public, on which the confidentiality and 
security are not controlled from end to end, and onto 

20 which a shared voice and/ or video resources host server 
is connected and provides a dynamic service to at least 
one customer, and onto which at least one call control 
seirver located at each customer is also connected. 

The invention consists of placing a voice resource 

25 in the WAN (capable of reproducing audio files, 
recording them, performing synthesis or voice 
recognition, detecting DTMF (Dual Tone MultiFrequency) 
tones from two sounds, equipped with a protected 
protocol that can remote control it from a wide area 

30 network (such as the Internet network) . 

The application that controls this voice resource 
may be located anywhere on the network. Thus, the 
server is a distributed platform in which expensive 
resources are located in the network, and in which the 
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service logic (software only) is located at the 
customer. 

Therefore, the invention can be used to share the 
voice resource server located in the network of an 
operator between several customers that execute the 
service logic in their premises. The companies simply 
need to have a connection with the data network. The 
operator server is accessible either from multimedia 
stations connected to the data network, or from any 
telephone through a gateway. 

With the invention, the supplier of the 
"accommodation" service provides a call control 
software to his customers, who run it locally on a 
machine in their network, and interface it with their 
critical databases. 

When a call arrives for this customer, it reaches 
the shared voice resource platform. This platform 
analyzes the requested number or the "ALIAS" for IP 
(INTERNET PROTOCOL) calls and deduces the client 
concerned. It sends a new call notification through 
the WAN to the call control application for the 
customer concerned. In particular, this application 
may ask the following in return: 

play a prerecorded audio file; 
synthesize a text; 
record a text; 

ask for a video sequence to be sent if the 
connected person has an appropriate terminal; 
make a voice recognition. 

The voice resource can be made above the H.323 
protocol so that users can be connected through the 
switched telephone network (through an STN/IP gateway) , 
or through the Internet network, indifferently. 
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In one advantageous embodiment, the host server is 
connected to the WAN through an Ethernet or other 
interface, and is composed of five subsystems: 

• A first subsystem, which is an H-323 protocol stack, 
5 for which the API {Application Programming Interface) 

is capable of: 

- detecting incoming calls and capturing the caller 
and called party numbers (or H.323 ALIAS); 

- detecting DTMF tones (transported in the H.245 
10 protocol) ; 

- generating media data streams (sound + video) 
with arbitrary coding-decoding; 

- receiving media data streams (sound + video) with 
arbitrary coding-decoding; 

15 

• Possibly a second subsystem, which is a high 
performance transcoding resource, typically a digital 
signal processor card capable of transcoding the 
G.711 / G. 723.1 protocols. 

20 

• Possibly a third subsystem which is a voice synthesis 
resource generating G.711 or G. 723.1 type data 
streams, possibly with "streaming" capacities 
(division of a large file into successive small 

25 elements with limited duration) . 

• Possibly a fourth subsystem, which is an audio and 
video sequence recording / reproduction module with 
"streaming" functions during reproduction. 

30 

The action of these subsystems is coordinated by a 
fifth subsystem which is essentially a command 
interpreter capable of : 

- generating new call detection messages to a call 
3 5 control server placed at a customer; it must 
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also choose the right call control server 
starting from the called niiinber; 

- generating event messages, for example 
corresponding to DTMF tones; 

- implementing commands from call control servers 
placed at customers, such as: 

* order to play a prerecorded audio or video 
file, 

* order to synthesize a voice message from a 
text, 

* order to go in waiting for a DTMF dial tone, 

* order to disconnect the call, 

* order for voice recognition or other 
application. 

Calls from the switched telephone network are 
translated by an STN network/H . 232 gateway for 
processing by the host server. The gateway function 
may possibly be integrated in the host server. 

Other subsystems (voice recognition, fax 
generation/ reception, etc.) may be added to increase 
the functional richness of the complete assembly. 

In one advantageous embodiment, the call control 
server located at the customer is a simple software 
(for example "Window NT" service) that receives events 
signaled by the host server and sends commands in 
reaction to these events. This software may run on a 
computer provided with two network interfaces, one 
connected to the Internet network to communicate with 
the host server, and the other connected to a company 
private network to dialog with databases and other 
industrial processes within the company. 
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The host computer is configured so as to not 
transmit IP packets from the Internet network to the 
internal network. 

The customer can configure the service logic itself 
5 using a script language (for example Java Script, 
VisualBasic) , or a graphic interface. 

The dialog protocol may be any secure dialog 
protocol with short waiting times. In one embodiment, 
10 a protocol is used on a standard UDP in which each 
information block sent is in the following form: 

<block><random><64 random bits></random><cipherblock> 

encrypted data</cipherblock> </block> 

15 

The encrypted information block must have the following 
structure once it has been decrypted: 

<clearinf o> 

2 0 <serial>serial nuinber</serial> 

<other information> ... <other information> 
</ clear info> 

Information encrypted in the "cipherblock" block is 
25 obtained by encrypting the "clear info" structure using 
the DES (Data Encryption Standard) standard in CBC 
(Cipher Block Chaining) mode, using the 64 random bits 
for the initial exclusive OR. The sender's identity is 
proven by the possibility of finding an intelligible 

3 0 message with decryption. The receiver must memorize 

the last serial niimber received from the sender and 
discard any message received with a serial number less 
than or equal to the current serial number. 

The sender can protect his transmission (UDP 
3 5 standard) by sending several identical messages. The 
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receiver memorizes the serial niamber of the first 
correctly received message and discards subsequent 
messages without examining them. 

Figure 1 illustrates a first example use, which is 
for the communication by an IP interactive voice 
server . 

A WAN network 10, for example Internet, in which 
the voice and/or video resource operator server 11 is 
connected to : 

- an ordinary telephone 12 through a WAN telephone 
gateway 13 ; 

- a multimedia station 14 through a two-directional 
link 15, of the H.323, SIP, or other type of 
voice data stream; 

- three servers 16, 17 and 18 for companies A, B 
and C. 

When the operator server 11 receives a new 
communication from a user, the first thing it does is 
to analyze the called nxamber and then deduces which 
company server should manage the communication; for 
example server 16 for company A. 

Company A makes fast part orders. Server 16 sends 
its welcome announcement stored in the welcome file in 
the operator server 11: "welcome to company A's fast 
order server, please press on the key to begin". 

Informed users can interrupt this announcement by 
pressing on the key. 

As soon as the user presses on ' * ' , the operator 
server 11 informs company A's server 16 with a "DTMF 
event" message. Company A's server 16 then begins to 
play the "Do_you_want_to_order " file which contains a 
recording of this phrase. 

Company A's server 16 decides to use the voice 
command, to order the operator server 11 to start 
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recognition on the "yes, no" vocabulary. As soon as 
the user says "yes", the server 16 is informed by a 
"Word_recognition" message. 

Server 16 then asks how many parts the customer 
wants to order and records this nximber by voice 
recognition. It then stops the voice recognition 
procedure by a " Stop_recognition" command. 

Finally, the server 16 repeats the amount of the 
order to the customer asking the operator server 11 to 
synthesize the "You have ordered three parts" character 
string. The user then hangs up. 

The dialog between the operator server 11 with 
voice recognition which receives an H.323, SIP or other 
voice data stream and company A's server 16, is 
illustrated in figure 2. 

Voice recognition procedures usually comprise two 
parts : 

- the first part (A) uses the voice data stream (64 
kbits for standard G.711 and 6.4 kbits for 
standard G. 723.1) and extracts significant 
components from it (spectrum, etc.), the result 
is a low rate data stream between 4 and 8 
kbits /s ; 

- the second part (B) attempts to recognize words 
in a vocabulary starting from components 
transmitted by the first part A. 

The scheme illustrated in figure 3 shows how the 
different modules of a voice recognition procedure 
communicate with each other. 

There are two ways of creating a voice recognition 
procedure in the IP interactive server: 

• When the customer who is calling the company 
server is not controlled by the network operator, 
the A and B components have to be put on the 
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operator server. This is the method used in the 
above example. 
• However if the network operator can, it is better 
to extract significant components at the customer 
in order to make less use of the passband on the 
network between the customer and the operator 
server. This extraction phase requires very 
little calculation power. 
For example, if the client is an IP telephony- 
software, the significant components extraction module 
may appear like a new speech encoder. The operator 
server then negotiates with the customer for use of 
this encoder during the connection. 

Another possible embodiment is to put a software 
component in a specialized displayed HTML page (ActiveX 
or Java) that interfaces with voice resources on the 
customer station and only sends significant components 
of the voice data stream to the operator server. Thus, 
a specialized page can be created which reacts to 
voice, as in the example in figure 3. 

Figure 4 illustrates another possible example 
embodiment with the IP audiotel server, for a 
specialized page that reacts to voice. 

In this example embodiment, the customer is a 
software object ("ActiveX or Java") integrated in a 
specialized page. This object sends significant voice 
data stream components input on the customer station 
computer to the operator server. It can do this using 
the RTP protocol on the IP network, or simply the TCP 
protocol if the reaction time is not a major 
constraint . 

The operator server recognizes words in this data 
stream and informs the company server of recognized 
words . 
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The company server then initiates actions as a 
function of the recognized words. For example, it can 
send a command message to the ActiveX component to 
display another specialized page. 

The following protocol is used: 

1. Connection request: Connection request message (operator 
server => company server) 

(Implicit in TCP/IP by opening the exchange mechanism in 
TCP/IP) 

2. Call data: Transmit call data (operator server => company 
server) 

Called number 
Calling number 

3. Read sound: Read a sound file (company server => operator 
server) 

Logical channel number 

Name of the element to which the response is to be notified 
Time in ms before playing the sound 
File name to be played 

Digit used to detect the end of the sound file 
Format of the sound file (Wav, Vox, ADPCM ...) 
Data format 
Sampling frequency 

4. DTMF event message (operator server => company server) 
Logical channel number 

DTMF key code 

5. Sound recording: Recording of a message (company server => 
operator server) 

Channel number 

Name of the element to which the response is to be notified 

Time before beginning the recording 

Name of the message save file 

End of recording character 

Maximum recording time 

Maximum silence time 

Save file format 

Data format 

Sampling frequency 

Send a beep to signal when the recording starts 

6. Send tone: Send a tone (company server => operator server) 
Channel 

Name of the element to which the response is to be notified 
TimeBef ore 
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Dial Tone 
Frequency 1 
Frequency 2 
Amplitude 1 
5 Amplitude 2 

Tone duration 

7. Read chain: Concatenate a string of characters (company 
server => operator server) 
Logical channel number 

Name of the element to which the response is to be notified 
Time before reading sound 

Character string, for which the data => sound conversion is 
to be made 

End of file character string 
Sound file format (Wav, Vox, ADPCM ...) 
Data format 

Sampling frequency format 

Mix size, so that two files can be mixed later (Smooth 
transition) 

Breakdown type, which will be used later for number 
generation time functions starting from a sound library 
Character used to separate expressions in the character 
string 

File name resulting from the concatenation 
Word field name 
Sound field name 
Dictionazy access path 

Disconnect user: The caller hung up (operator server => 
Company server) 

Logical channel number to be disconnected 

(Implicit in TCP/IP by closing the TCP/IP exchange mechanism) 

Disconnect server: Disconnection request by the company 
server software (company server => operator server) 
Logical channel number to be disconnected 

10. Voice synthesis: 

40 Logical channel nTimber 

Name of the element to which the response is to be notified 

Text to be converted in voice synthesis 

Choose a specific voice, if required 

Speaking speed 
45 Speaking frequency 

11. Extended call (function of the call transfer request) 
Logical channel niomber 

50 Name of the element to which the response is to be notified 

Transfer request time 

Number to which the call is to be transferred 
Cal 1 type 
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Nioinber of rings before abandon 

Time to analyze the result of the transfer request 

12. Start recognition (function requesting beginning of voice 
5 recognition) 

Logical channel number 

Name of the element to which the response is to be notified 
Name of the words file to be analyzed 
Digit used to detect the end of the sound file 
10 Maximum recording time 

Maximum silence time 

Send a "beep" signaling the beginning of the recording 

13. Stop recognition (function requesting the beginning of voice 
15 recognition) 

Logical channel number 

14. Word recognition (function requesting the beginning of voice 
recognition) 

2 0 Logical channel niimber 

Name of the element to which the response is to be notified 
List of recognized words 

We will now describe several other example 
25 embodiments. 

• Call from the telephone network 

A person who would like to book a journey calls 
0836011234. This number actually connects to an 
30 STN/H.323 network gateway that converts the call into 
IP data and sends it to the host voice resources 
server . 

The voice resources server analyzes the requested 
number and deduces that the call must be controlled by 
35 the call control server located at the IP address 
192.12.13.14 (located in the travel agent). 

Therefore, it sends a new call message to the 
travel agent's call control server. This call control 
server asks it to play a musical background quickly 
40 presenting the company and asking the caller to press 
"1" to book a voyage, or "2" to leave a message. 
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The person presses "1" and the host voice resources 
server retransmits the event to the travel agent's call 
control server. 

The dialog continues. It could be imagined that 
the travel agent would like to announce the price of a 
particular voyage. The call control server looks in 
the travel agent's database for prices and 
availabilities, and asks the host voice resources 
server to play the recorded string "the price of your 
voyage is", and then to synthesize "2345" and then play 
"Francs" . 

• Call from the Internet network 

An H.323 terminal clicks on a link starting from a 
travel agent's Internet site, provoking a call from the 
H.323 terminal to the H.323 host server. The server 
analyzes the called number and sends an indication for 
the new call to the travel agent's call control server. 

The travel agent's call control server does not 
need to be modified, and can execute the same scenario 
as in the previous case. 

But it can also choose to offer more services, 
since a protocol element informs it at the time of the 
indication of the new call that the call is incoming 
from the Internet network, it can suggest that a 
specific page should be viewed, or even give the order 
to the host server to play a video sequence describing 
a particular voyage. 

The call is free for the Internet network user. 

• Call from another country 

If the operator has installed another host voice 
resources server in another country, the travel agent 
may be accessible from this country. The operator 
simply reserves a number that is forwarded to the local 
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voice resources server. The server continues to 
contact the company's call control server. The source 
of the call is indicated when a new call indication is 
received, so that the call control server can 
dynamically adapt to the most suitable language when it 
is helpful to do so. 

This solution is much less expensive than a 
conventional solution, since no international voice 
communication is necessary. 
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CLAIMS 

1. Multimedia data transmission system, comprising 
a wide area network, the confidentiality and security 
of which are not controlled from end to end, to which a 
shared voice resources and/or video resources host 
server providing a dynamic service to at least one 
user, and at least one call control server located at 
each service supplier, are connected. 

2 . System according to claim 1 in which the host 
server, connected to the network through an interface 
is composed of five subsystems: 

• A protocol stack subsystem with an interface that: 

- receives calls from the data network at the 
exchange ; 

- detects incoming calls and captures caller and 
called party numbers; 

- detects dial tones; 

- generates arbitrary coding-decoding media data 
streams; 

- receives arbitrary media coding-decoding data 
streams . 

• A command interpreter subsystem capable of: 

- generating messages on detection of new calls to a 
call control server located at a customer; 

- generating event messages; 

- making use of commands originating from call 
control servers placed at customers, such as: 

3 . System according to claim 2 , comprising a high 
performance transcoding resource subsystem. 

4. System according to claim 3, comprising a voice 
synthesis and/or video resources subsystem. 

5. System according to claim 4, comprising an 
audio or video sequences recording /reproduction module 
subsystem. 
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6. System according to claim 1, in which each call 
control server located at a client is a software that 
receives events signaled by the host server and sends 
commands in reaction to these events. 
5 7. System according to claim 6, in which the 

software is running on a computer provided with two 
network interfaces, one connected to the WAN to 
communicate with the host server, the other connected 
to a company private network in order to dialog with 
10 the customer's databases and other industrial processes 
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MULTIMEDIA DATA TRANSMISSION SYSTEM 

This invention is related to a multimedia data 
transmission system comprising a wide area network 
(10) , the confidentiality and security of which are not 
controlled from end to end, to which a shared voice 
resources and/or video resources host server (11) 
providing a dynamic service to at least one customer, 
and at least one call control server located at each 
customer, are connected. 

Figure 1 
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than the United States, listed below and have also identified below, by checking the box, any foreign application for patent or 
inventor's certificate, or PCT International application having a filing date before that of the application on which priority is 
claimed. Prior Foreign Application (s) 



on 



and was amended imder PCT Article 19 



on 



Application No. 



Coxmtry 



Day/monthAT ear 



Priority 
Claimed 



98 14719 



FRANCE 



23/11/1998 



lElYES 

□ yes 

□ yes 

□ yes 



□ no 

□ no 

□ no 

□ no 
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- We (I) hereby claim the benefit under Title 35, United States Code, § 119 (e) of any United States provisional 
application(s) listed below. 



(Application Number) (Filing Date) 



(Application Number) (Filing Date) 

We (I) hereby claim the benefit mider 35 U.S.C. §120 of any United States application(s), or § 365(c) of any PCT 
International application designating the United States, listed below and, insofer as the subject matter of each of the claims of 
this application is not disclosed in the prior United States or PCT International appUcation in the manner provided by the 
first paragraph of 35 U.S.C. § 112, I acknowledge the duty to disclose information which is material to patentability as 
defined in 37 CFR § 1.56 which became available between the filing date of prior application and the national or PCT 
International filing date of this application. 



Status (pending, patented. 
Application Serial No. Filing Date abandoned) 



And we Q.) hereby appoint : Norman F. Obion, Registi^tion Number 24,618; Marvin J. Spivak, Registiation Number 
24,913; C, Irvin McClelland, Registiration Number 21,214; Gregory J. Maier, Registiration Number 25,599; Arthur I. 
J Neustadt, Registration Number 24,854; Richard D. Kelly, Registration Number 27,757; James D. Hamilton, Registration 
f| Number 28,421; Eckhard H. Kuesters, Registiation Number 28,870; Robert T. Pous, Registiation Number 29,099; 
: J Charles L. Gholz, Registiration Number 26,395; Vincent J. Sunderdick, Registiation Number 29,004; William E. 
, Beaumont, Registration Number 30,996; Steven B. Kelber, Registiation Number 30,073; Robert F. Gnuse, Registiation 
Number 27,295; Jean-Paul Lavalleye, Registiation Number 31,451; William B. Walker, Registiation Number 22,498; 
Timotiiy R. Schwartz, Registration Number 32,171; Stephen G. Baxter, Registi-ation Number 32,884; Martin M.,. Zoltick' 
Registiation Number 35,745; Robert W. Hahl, Registration Number 33,893; and Richard L. Treanor, Registiation 
~ Number 36,379; our (my) attorneys, with fiill powers of substittition and revocation, to prosecute this application and to 
■ ■ tiansact all business in tiie Patent Office connected therewith; and we (I) hereby request that all correspondence regarding 
this application be sent to tiie firm of OBLON, SPIVAEC, McCLELLAND, MAIER & NEUSTADT, P.C., whose post 
? Office Address is : Fourth Floor, 1755 Jefferson Davis Highway, Arlington, Virginia 22202. 

We (I) declare that all statements made herein of our (my) own knowledge are true and that all statements made on 
information and belief are believed to be tine ; and future that these statements were made with tiie knowledge that willful 
false statements and the like so made are punishable by fine or imprisonment, or both, under Section 1001 of Titie 18 of 
the United States Code and that such wilful false statements may jeopardise the validity of the application or any patent 
issuing thereon. 



HERSENT Olivier 



NAME OF FIRST SOLE INVENTOR 




Residence: ^ L KM , ^ 

r^O0/} r i^fhj FRANCE 

Citizen of : f k fili CC 

Post Office Address : The same as residence 



